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ABSTRACT 

In  this  note  It  is  shown  that  a  two-stage  stochastic  program  with 
recourse  with  right-hand  sides  random  (i.e.,  a  two-stage  programming  under 
uncertainty  problem)  has  optimal  decision  rules  which  are  continuous  and 
piecewise  linear.  However,  this  result  does  not  extend  to  programs  with 
three  or  more  stages.  An  example  is  given  of  a  simple  inventory-type 
three-stage  stochastic  program  with  recourse  for  which  the  optimal 
second-stage  decision  rule  is  not  piecewise  linear.  The  example  is 
also  recast  in  the  framework  of  the  conditional  probability  E-model  of 
chance-cons  trained  programming  showing  that  the  Chames-Kirby  theorem 
on  the  existence  of  piecewise  linear  decision  rules  for  such  programs 


is  invalid  for  moie  than  two  stages. 


A  NOTE  ON  DECISION  RULES  FOR  STOCHASTIC  PROGRAMS 

In  this  note  it  will  be  shown  that,  in  a  sense  to  be  made  precise, 
a  two-stage  stochastic  program  with  recourse  with  right-hand  sides 
random  (i.e.,  a  two-stage  programming  under  uncertainty  problem)  has 
optimal  decision  rules  which  are  continuous  and  piecewise  linear.  The 
proof  relies  on  a  basic  property  of  linear  programs  established  in  [9].  How 
ever,  this  result  does  not  extend  to  stochastic  programs  with  three  or  more 
stages.  An  example  will  be  given  of  a  simple  inventory- type  three-stage 
stochastic  program  with  recourse  for  which  the  optimal  second-stage 
decision  rule  is  not  piecewise  linear.  The  example  is  then  recast  in  the 
framework  of  the  conditional  probability  E-model  of  chance-constrained 
programming  given  by  Charnes  and  Kirby  in  [lit  showing  that  the  central 
theorem  of  [1],  [4],  and  [5]  on  the  existence  of  piecewise  linear  decision 
rules  for  such  programs  is  invalid  for  more  than  two  stages.  The  example 
may  also  be  of  value  to  the  reader  as  an  illustration  of  certain  concepts 
in  the  theory  of  stochastic  programs  with  recourse. 

Consider  the  two-stage  stochastic  program  with  recourse  with  right-hand 
sides  random: 

(1)  inf  cx  +  E  {min  qy} 

x  ^  y 

Ax  -  b 

Tx  +  Wy  -  £ 

x  >  0  y  >  0 
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where  c,  q,  A,  b,  T,  and  W  are  fixed  matrices  of  size  1  x  n, 

1  x  n,  m  x  n,  m  x  X,  m  x  n,  and  m  x  n  respectively  and  £  is  a  random 
column  m-vector  with  known  distribution.  The  support  of  the  random 
vector  £  is  defined  to  be  the  smallest  closed  set  of  values  of  £  with 
probability  measure  1.  This  special  case  of  stochastic  programs  with 
recourse  is  essentially  the  programming  under  uncertainty  model  which  is 
studied  in  [3],  [11],  etc.  and  out  of  which  the  study  of  stochastic 
programs  with  recourse  grew.  Of  course  as  it  stands  (1)  is  just  a 
notational  abbreviation.  A  detailed  explanation  of  (1)  may  be  found  in 
[11];  a  similar  explicit  formulation  for  the  general  stochastic  program 
with  recourse,  in  which  the  components  of  £  include  elements  of  c,  q, 

T,  and  W  as  well  as  the  right-hand  sideB,  may  be  found  in  [6].  The 
pertinent  concepts  and  results  from  [6]  and  [11]  are  outlined  in  the 
following  paragraph. 

For  every  pair  of  values  of  the  vectors  x  and  £  ,  Q(x,£)  is 

defined  to  be  the  optimal  value  of  the  second-stage  program 

(2)  min  qy 

y 

Wy  -  K  -  Tx 
y  >  0 

where  it  is  understood  that  Q(x,£)  is  -H»  or  -»  if  (2)  is  infeasible 
or  feasible  and  unbounded  below.  The  usual  definition  of  integration  is 
extended  in  [6]  to  encompass  the  cases  of  divergence  and  infinite  integrand. 
Thus  Q(x)  ■  E^Q(x,S),  the  expected  value  of  Q(x,£)>  can  be  unambiguously 
defined  for  all  x.  It  is  shown  in  [8]  that  with  this  definition  of  ex¬ 
pected  value  and  the  appropriate  definition  of  convexity  for  functions 


i 
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lnto  the  extended  reals  Q(x)  Is  a  lower  semi  continuous  convex  function. 
Thus  (1)  has  an  equivalent  convex  program 

(3)  inf  cx  +  Q(x) 

x 

Ax  ■  b 
x  >  0 

where,  of  course,  Q(x)  may  be  infini  te  for  certain  values  of  x.  A 
vector  x  is  said  to  be  (strongly)  feasible  for  (1),  or  equivalently 
(3),  if  it  satisfies  the  linear  constraints  Ax  -  b,  x  >  0  and  if 
Q(x)  <  +«>.  If  the  infimum  in  (1),  i.e.,  in  (3),  is  finite  and  achieved 
for  some  vector  x,  then  x  is  said  to  be  optimal. 

The  major  positive  result  of  this  note  is  the  following: 

THEOREM.  If  a  two-stage  stochastic  program  with  recourse  with 

right-hand  sides  random  (1)  has  a  feasible  solution  x°  yielding  a 
finite  value  of  the  objective,  in  particular  if  x°  is  an  optimal 
solution,  then  there  exists  a  continuous  piecewise  linear  vector-valued 
function  y°(*)  defined  on  a  polyhedral  region  £(x°)  containing  the 
support  5  of  the  random  variable  £  such  that  for  all  £  in  E(xu), 
and  hence  for  all  £  in  E,  y°(£)  is  a  finite  optimal  solution  to  the 
second-stage  program  (2)  given  x  ■  x° . 

Proof.  Let  pos  W  denote  the  closed  convex  polyhedral  cone  with 
apex  at  the  origin  consisting  of  all  column  m-vectors  which  can  be  written 
as  a  nonnegative  weighted  sum  of  columns  of  W,  i.e.,  pos  W  =  { t ) t  ■  Wy, 
y  -  0 }.  The  second-stage  program  (2)  is  feasible  for  given  x  and  £ 
if  and  only  if  £  lies  in  the  translated  cone  l (x)  =  pos  W  -  Tx.  Since 


S 
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x°  is  feasible,  we  have  Q(x°)  ■  ErQ(x°,0  <  +».  From  the  definition 
of  expectation  given  in  [6]  it  follows  that  Q(x°,£)  must  be  less  than 
+*  with  probability  1,  i.e.,  £(x°)  must  have  measure  1.  But  E(x°) 

*"w 

is  closed  and  E  is  the  smallest  closed  set  of  measure  1,  hence 
£ (x°)  D  S.  Now  if  the  second-stage  program  (2)  is  unbounded  for  one 
feasible  right-hand  side,  it  is  unbounded  for  all  feasible  right-hand 
sides.  That  is,  if  Q(x°,0  -  for  some  £,  then  Q(x°,£)  *  for 
all  £,  in  E(x°).  But  if  Q(x°,£)--“  for  all  £  in  E(x°),  then, 

by  the  definition  of  E,  Q(x°)  -  E^Q(x°,£)  «  Since  x°  yields  a 

finite  value  of  the  objective  in  (3),  it  follows  that  the  second-stage 
program  (2)  has  a  (finite)  optimal  solution  y(£)  for  x  -  x°  and  all 
£  in  E(x°).  Up  to  this  point,  the  proof  of  the  theorem  is 
essentially  a  review  of  some  of  the  results  of  [6]  and  [11], 

We  may  now  apply  the  Basis  Decomposition  Theorem  of  [91  to  conclude  that 
the  optimal  solution  y°(£)  may  be  chosen  for  each  £  in  E(x°)  in 
such  a  way  that  y°(*)  is  continuous  and  piecewise  linear  on  E(x°). 

In  view  of  this  theorem,  it  is  natural  to  ask  if  programs  of  more 
than  two  stages  also  have  piecewise  linear  optimal  decision  rules.  They 
do  not  in  general,  as  the  following  example  will  show.  Consider  the 
three-stage  stochastic  program  with  recourse: 

(4)  min  0.6x  +  E.j  min  Oyj  +  0y2  +  E>  |^.{min  Zj  +  z2}j 

x  <  2 

-x  +  yi  +  y2  H 

*i  +  zi  -  «i 

y2  +  z2  -  s2 

>  o 


x»y  i »y2 »zi *z2 


where  £,  ^ ,  and  are  independent  random  variables ,  £  is  uniformly 

distributed  on  [0,2],  is  uniformly  distributed  on  [0,1],  and  £2 

is  triangularly  distributed  on  [0,1],  i.e.,  P(£2<A)  ■  A2.  This  three-stage 

program  may  be  interpreted  as  an  inventory  problem.  An  amount  x  of  an 
infinitely  divisible  commodity  may  be  purchased  at  a  price  of  0.6  per 
unit.  An  additional  amount  £  is  then  received  at  no  cost,  and  amounts 
yj  and  y2  of  the  total  are  sent  to  two  distribution  facilities.  If 
either  of  the  demands  c1  and  £2  exceeds  the  supply  at  the  corresponding 
facility,  the  deficiency  is  made  up  at  a  cost  of  1  per  unit.  Notice  that 
this  program  has  the  property  of  complete  recourse  as  described  in  [3], 
that  is,  the  second  stage  is  always  feasible  for  any  choice  of  x  satis¬ 
fying  the  first-stage  constraints  and  any  value  of  £,  and  the  third 
stage  is  always  feasible  for  any  feasible  choice  of  Vj  and  y2  and  any 
values  of  and  ?2« 

Rewriting  the  constraints  In  equality  form  with  slack  variables 
s1  and  s2,  the  third-stage  program  is 

Q2(y,0  -  min  +  z2 

z  ,s 

Z1  -sl  *  *  *1 

Z2  -S2  =  C2  -  y2 

z1,z2,s1,s2  ±  0 

This  is  a  case  of  simple  recourse  as  considered  in  [10].  By  the  well 
known  separability  property  of  such  problems, 

Q2(y)  «  E^Q2(y,C)  - 

where 
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E  Qj(y1,C1)  -  Q2 <y j) 
1 

(5) 

E;  Q,2<y2‘c2)  "  Q2<y2) 


-yl  +  2 

if 

1  A 

O 

|(yri)2 

if 

0  <  yt  <  1 

0 

if 

h- 4 

1  A 

~y 2  +  f  if  y2  - 

'  3  y|  -  y2  +  §  if  0  <  y2  < 

0  if  1  <  y2 


Fig*  1  includes  a  plot  of  selected  level  curves  for  Q2(yj>y2) 
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The  equivalent  seconds tage  program  is 

(6)  Qj (x,£)  -  min  Oyt  +  Oy2  +  Q2(y1»y2) 

y 

y1  +  y2  <  €  +  x 
yx  i  0,  y2  l  0. 

From  an  examination  of  Figure  1  it  is  not  difficult  to  see  that  for  each 
value  of  t  *  5  +  x  in  the  interval  [0,2]  the  optimal  solution  to  (6) 
is  unique  and  lies  on  a  curve  C.  When  t  ■  5  +  x  is  greater  than  2 
the  optimal  solution  is  not  unique;  if  a  specific  solution  were  desired, 
a  natural  choice  would  be  y1  «  y2  ■  1.  With  a  little  straightforward 
analysis  it  can  be  shown  that  the  optimal  solution  (y°  (£+x)  ,y°  (£+x)) 
for  Oi  (  +  x<2  is  given  by 


y°U+x) 


-1  +  VI  +  4  ( £+x) 
2 


y°a+x)  -  £  +  x  -  y°U+x). 


Thus  C  is  the  parabola  yj  ■  y2 . 


The  equivalent  firststage  program  is 


min  z(x)  ■  0.6x  +  Qj(x) 


0  <  x  <  2 


where 


Qj(x)  - 


/■2+x  . 

'J  Q2(yS(t)»y2Ct))  y  dt 


(8) 
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As  has  been  observed  in  [3]  the  objective  z(x)  is  necessarily  convex; 
however,  this  can  be  verified  directly.  For  values  of  t  greater  than 
2  the  Integrand  in  (8)  is  zero.  Hence  the  upper  limit  may  be  replaced 
by  2  and 

(9)  z(x)  -o.6  -  \  Q2(yJ(x)»y^x)) 

From  Fig.  1  it  can  be  seen  that  the  right-hand  side  of  (9)  is  increasing 
in  x,  so  that  z(x)  is  indeed  convex.  With  a  little  labor  the  integral 
(8)  may  be  evaluated  in  closed  form,  but  this  is  not  essential  to  the 
solution  of  the  program. 

On  substituting  x  -  0  into  the  right-hand  side  of  (9)  and  making 
use  of  (5)  and  (7)  it  will  be  found  that  the  derivative  of  z(x)  at 
x  -  0  is  strictly  positive.  It  follows  that  x°  -  0  is  the  unique 
optimal  first-stage  decision  for  the  stochastic  program  (A).  The  optimal 
second-stage  decision  as  a  function  of  the  observed  second-stage  random 

variable  £  is  obtained  by  setting  x  -  0  in  (7) .  Since  the  optimal 

second-stage  decision  is  unique  for  £  in  the  interval  [0,2],  and 

since  the  random  variable  £  is  distributed  continuously  over  this 
interval,  it  follows  that  any  piecewise  linear  substitute  for  the  optimal 
decision  rules  would  be  nonoptimal  with  probability  1  and  lead  to  a  value 
of  the  objective  of  the  stochastic  program  (A)  strictly  less  than  optimal. 

Finally,  consider  the  following  variant  of  (A): 


) 
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(10)  max  E(-0.6x  -  Zj  -  z2) 

P(b1  >  x)  >  0.9 

P(b'  >  -x  +  yA  +  y2  |  bA)  >  0.9 

P(b’’  >  -  -  y2  I  bj)  >  0.9 

P(b'3  >  -  y:  -  Zj  |  bj.b'.bp  >  0.9 

P(b 3  >  -  y2  -  z2  I  bj.b2.b2)  >  0.9 

x,  y j ,  y2,  z j ,  z2  >  0 

where 

bj  -  C  +  1.8 

bj  -  C  +  -  0.1  b;--Cj  +  n  -  0.1 

b2  -  C2  b3  -  -C2  +  n  "  0*1* 

£,  Cj*  and  C2  are  independent  random  variables  with  the  distributions 
given  in  connection  with  the  recourse  problem  (4),  n  is  a  random  variable 
independent  of  C,  tj.  and  S2,  with  uniform  distribution  on  [0,1], 
and  P(b*  -  ...  |  b^  denotes  conditional  probability  with  respect  to 
bj,  etc.  It  can  be  seen  immediately  that  this  program  is  a  conditional 
probability  E-model  chance  constrained  program  as  defined  by  Charnes  and 
Kirby  in  [1].  It  is  shown  in  [1]  that  essentially  any  such  program  is 
equivalent  to  another  in  which  the  chance  constraints  are  replaced  by 
constraints  involving  the  fractile  points  of  the  conditional  distribution 
functions  of  the  random  variables.  It  is  easy  to  see1  that  the  fractile 
form  of  the  stochastic  program  with  chance  constraints  (10)  is  exactly  the 

1The  case  of  two-stage  programs  is  examined  in  detail  in  Section  5  of  [7]. 
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stochastic  program  with  recourse  (4)  except  for  an  additional  constraint 

y,  +  y2  >  -  \/oTl,  which  arises  from  the  second  of  the  two  second-stage 

constraints  in  (10).  Since  the  addition  of  this  constraint  clearly  does 

not  affect  the  form  of  the  optimal  decision  rules  (7),  they  are  also 

optimal  decision  rules  for  (10).  This  example  shows  that  Theorem  2  of 

[1],  which  asserts  that  the  optimal  decision  rules  are  piecewise  linear, 

is  invalid  for  more  than  two  stages.  This  same  theorem  has  also  appeared 

in  [4]  and  [5]  and  is  relied  upon  in  an  essential  fashion  in  the  proof 

of  Theorem  3  of  [2],  which  considers  optimal  decision  rules  for  the  P-model 

of  chance  constrained  programming.  Note  that  if  the  random  variables  are 

discretely  distributed  on  a  finite  set  these  theorems  are  valid  but  trivial, 

1c 

since  any  function  defined  on  a  finite  subset  of  R  has  a  piecewise  linear 
k 

extension  to  R  . 


i 
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